• 专利附录
  • 专利说明
  • 权利要求
  • 类似技术
  • 同族专利
  • 引用文献
  • 法律状态
  • 优先权
    • 专利摘要:
    The invention relates to a control device with voice and / or gesture recognition (1) for the interior lighting of a motor vehicle comprising a plurality of lighting modules (Mn) each capable of emitting at least one light beam into a light beam. cockpit (2) of the vehicle. The device comprises at least separate means for detecting (3, Cn) a plurality of voice and / or gesture commands (Sn), executed by at least one occupant of the vehicle in specific zones (Zn) of the passenger compartment. (2) targeted by said detection means, said detection means (3, Cn) being able to transmit data representative of said commands (Sn) to at least processing and analysis means (4, ECU) configured to merge and prioritizing said data and generating, after comparison with reference data, at least one instruction (An) to at least one interior lighting module (Mn).
    公开号:FR3049078A1
    申请号:FR1652417
    申请日:2016-03-21
    公开日:2017-09-22
    发明作者:Aymeric Koniec；Thierry Fleurence
    申请人:Valeo Vision SA；
    IPC主号:
    专利说明:

    DEVICE AND METHOD FOR VOICE AND / OR GESTURAL RECOGNITION CONTROL FOR INTERIOR LIGHTING
    VEHICLE
    The present invention relates to a voice and / or gesture-enabled control device and method for interior lighting of a vehicle in which communication between the elements can be carried out via a multiplexed network. Electronics is more and more present in motor vehicles, and more and more sophisticated. The electronics are now used as support for most vehicle functions, such as in an engine management system, an active and passive safety system (ABS anti-lock system, ESP electronic stability program, AFU emergency braking assistance). , airbags, belt, reversing radar, antitheft) or a comfort system (air conditioning, lock, on-board computer, navigation). Electronics thus allows the development of autonomous and communicating vehicles in which there is provided an exchange of information between the occupant and the vehicle by the use of tactile or voice interfaces. Some vehicles may provide gesture recognition systems for active vehicle safety applications such as driver vigilance monitoring. These systems are able to detect and analyze movements of the head, face and eyes of the driver such as, for example, eyelid opening, pupil position, gaze direction, position and inclination of the head. The system, consisting of a detection unit, a calculation unit and a software, is then able to determine the level of alertness and distraction or the state of sleepiness of the driver and can, therefore, transmit an alert for falling asleep or distraction in real time.
    The process associated with such a gesture recognition system comprises at least one step of detecting and collecting data, a step of comparing the information obtained with reference data and then a step of controlling and / or controlling implementation functions. vehicle safety. In response to a loss of vigilance or a diversion of the driver's attention, the on-board systems have the ability to intervene on the control of the vehicle by proposing, for example, a help to maintain trajectory, automatic braking at full power, speed regulation or piloting assistance. The increase in the electronic functions of the aforementioned engine management, safety and comfort systems has the consequence of increasing the number of computers, sensors and electrical cable bundles. In this context, we know the use of multiplexed network which makes it possible to limit the number of components, the size of the wiring and the associated costs. Such multiplex network consists of circulating several information between various computers on a single transmission channel, also called data bus. These multiplexed networks are known by the English names "Controller Area Network" or CAN, "Vebicle Area Network" or VAN and "Local Interconnect Network" or LIN.
    In this dual context of driver command recognition and multiplication of electronic components in the vehicle, the object of the invention is to propose a device capable of detecting, analyzing and prioritizing a plurality of voice and / or gesture recognition commands. interior lighting in which the communication between the elements, in particular the transmission of the instructions to the lighting modules, can be achieved via a multiplexed network. The device of the invention enhances the safety of the occupants of the vehicle by giving priority to the commands executed by the driver and by not disturbing the vigilance of the latter which remains focused on the path of the vehicle. The comfort and well-being of the occupants are also improved. The invention relates to an interior lighting control device of a motor vehicle comprising at least two light sources each capable of emitting at least one light beam in the passenger compartment. The device comprises at least separate means for detecting a plurality of commands, these detection means being able to transmit data representative of said commands to at least processing and analysis means configured to merge and prioritize said data and generate , after comparison with reference data stored in a database, at least one instruction to at least one of the light sources for its activation.
    The light sources are distinguished in that they are configured to emit a particular light beam relative to each other, or part of a light beam. In particular, these light sources may consist of one or more sources arranged in separate lighting modules, or they may be formed by a light-emitting diode of RGB type, namely three red, green, blue chips. Without this list being exhaustive, it is also possible to provide a matrix of light-emitting diodes for producing selective lighting.
    The detection means may be configured to detect a plurality of voice and / or gesture commands performed by at least one occupant of the vehicle in specific areas of the passenger compartment targeted by the detection means.
    According to one characteristic of the invention, the interior lighting controls are gestural commands consisting of a plurality of gestures forming a specific gestural sequence. By gestural sequence is meant a succession of gestures defined by the movement of all or part of the body of at least one occupant, preferably an upper limb of an occupant, preferably the driver, each upper limb consisting of three segments: arms, forearms and hand. A gestural sequence is detected since at regular intervals, advantageously very short, a position different from the part of the body detected in motion is recorded.
    A gestural sequence is mainly defined by a trajectory executed in an active detection zone of the passenger compartment, in a vertical, horizontal, or diagonal orientation, in one direction or the other. The orientation of the sequence of gestures, that is to say the direction and direction that can be determined by putting all the positions of the part of the body detected end to end, makes it possible to determine an ignition or an extinction of a light source and / or a corresponding orientation of all or part of the lighting module to move the beam accordingly.
    The execution speed of the gesture sequence can also be taken into account. It is understood that depending on the amount of lighting modules to be activated and their positions in the passenger compartment, many combinations of gestures associated with specific detection areas can be created so as to constitute a functional sign language.
    Similarly, active detection zone means an area of the passenger compartment that can be defined as well by one or more plane surface (s), in two dimensions (2D) that by one or more volume (s) in three dimensions (3D). The active detection zone can cover the cabin in a wide way, focusing on the center axis of the cabin, or to improve the definition of the images taken in the area, be targeted on a part of the cabin in which an occupant has been detected, and in particular on the part of the cockpit associated with the driver. Preferably, the control detection means are targeted to three distinct specific zones: the conducting zone, the front passenger zone and the rear passenger zone.
    The detection means can in particular comprise means for acquiring, from a network, data transporting the commands, voice and / or gestures. The network may consist of a network embedded on the vehicle, as well as a wireless network for example bluetooth, WiFi, Lifi, a wired network type CAN or LIN, or it may consist of an external wireless network to the vehicle.
    More particularly, it can be provided that a control device according to the invention comprises at least a plurality of command detection modules, which can be distinct from each other both by their operation and by their location in specific areas of interest. the cabin, each module being configured to at least detect an interior lighting control performed by at least one occupant of the vehicle in at least one of said specific areas, analyze this command and transmit data representative of said control, a control unit known as ECU, of the English "Electronic Control Unit", connected to said control detection modules and configured to receive, process and analyze a plurality of data representative of a plurality of commands, and transmit at least one resultant instruction to at least one lighting module, being understood that this instruction could consist of an instruction of lighting and / or extinguishing and / or of variation of the luminous intensity and / or orientation of a beam emitted by the at least one lighting module, means communication system, configured to circulate data representative of at least one interior lighting control transmitted by at least one detection module to the electronic control unit ECU, said communication means being able to constitute a wireless network, Bluetooth-type preference, a wired network or a multiplexed network, and downstream communication means, configured to circulate at least one instruction output from the ECU electronic control unit to at least one light source, said communication means constituting a multiplexed network, preferably of CAN and / or LIN type.
    In addition to the foregoing, provision may be made for the electronic control unit to be configured to merge and synthesize data representative of a plurality of commands into one or more resultant instructions. And it could furthermore, in combination or independently of the foregoing, be configured to compare data representative of a plurality of commands with reference data and determine whether triggering conditions of a lighting function are achieved. The electronic control unit could also prioritize the data coming from the different detection modules, and to establish one or more resulting instructions on the basis of a selection of these data, for example in order to privilege, for security reasons, the command executed by the driver.
    The light sources for the interior lighting of the vehicle can be configured to provide functional lighting and / or ambient lighting and / or lighting for the projection of information.
    Functional lighting means lighting that improves the visibility of specific areas of the vehicle interior. For this purpose, it will be possible to provide at least one light source, in particular consisting of at least one LED, which can be accommodated, for example, in the ceiling unit for a directional lighting type reading light.
    Ambient lighting refers to lower intensity lighting that enhances interior details, such as the outline of the dashboard and doors, or decorates specific areas such as the vehicle ceiling. . For this purpose, it will be possible to provide at least one light source formed of a matrix of light-emitting diodes selectively activatable and housed, for example, in the ceiling unit.
    By lighting for information projection is meant the projection of a light beam on a neutral support by means of a light source independent of the support. For example, a projector can, using diodes, project on the windshield information on the speed and navigation of the vehicle (fuel level, traffic, alerts of mechanical defects).
    The detection means consist of at least one detection module of an interior lighting control capable of detecting, capturing and recording any interior lighting control, gestural and / or vocal, performed by at least one occupant of the vehicle in at least one specific area of the cabin, analyze this command and transmit data representative of said command.
    Each detection module can be configured to record a plurality of commands whose production sequence forms the interior lighting control. The data recording thus makes it possible to reconstruct the sequence of successive images forming the command, and this also makes it possible to facilitate the management of a database of reference gesture commands serving as a basis of comparison for determining whether conditions of triggering of the lighting control are carried out.
    According to an advantageous characteristic of the invention, the detection module and, if appropriate, voice and / or gestural control recording of the control device according to the invention is oriented towards at least one active detection zone of the vehicle interior and consists of at least one detecting means capable of detecting and, where appropriate, recording at least one voice message and / or a directional movement or gesture of at least one occupant of the vehicle in said detection zone active and / or, in the case of gestural control, at least one image acquisition means adapted to capture and record a sequence of images corresponding to the gestural sequence detected by said detection means.
    In the case of gestural control, the image acquisition means is activated as soon as a movement and / or gesture is detected by the detection means in the active detection zone in order to prevent the detection means from being detected. Image acquisition works continuously and consumes energy. It may be envisaged that the control device has no detection means, it being understood that this means has a function of detecting an initiating gesture of a sequence of gestures to be acquired subsequently. In this case, a shooting is ensured continuously on the detection zone and the images acquired are all processed.
    In the case of gesture recognition control, the gesture sequence detection and recording module may comprise a single image acquisition means, oriented on a single active detection zone so that the driver is the only one able to interact with the gesture recognition control device or comprise a plurality of image acquisition means, oriented on one or more active detection zone (s), so that the all occupants of the vehicle are able to interact individually with the gesture recognition control device. The passenger compartment of the vehicle is preferably equipped with a plurality of detection and control recording modules targeted at a plurality of specific zones of active detection so that all the occupants of the vehicle are able to interact individually with the control device according to the invention.
    The voice or gesture control detection means may consist of any type of sensor and / or camera, able to detect at least one voice sequence or a movement or gesture of a vehicle occupant in a predefined active detection zone. By way of non-limiting example, the sensor may be, in the case of a voice command, a microphone capable of capturing the human voice while reducing the ambient noise to hear the commands. In the case of gestural control, the sensor may be an infra-red sensor and / or ultrasound and / or radar type. The detection means may comprise a plurality of sensors of different types, and such or such sensor may be selected based on information received on the light conditions by the control module.
    The image acquisition means of the detection module and gesture sequence capture consists of any 2D or 3D shooting means, source of images and / or videos, said means being able to capture, generate and record 2D or 3D fixed or directional gesture sequences executed in a specific active detection zone. By way of non-limiting example, the means of shooting consists of one or more camera (s) and / or camera (s) photos. By camera is meant, for example, a thermal camera and / or a camera for visible light and / or an infra-red camera that can operate at any level of light intensity in the cabin and / or laser camera and / or a radar.
    In the case of gestural control, the data acquired and generated by the gesture sequence detection and recording module constitute representative data defining mono, bi or three-dimensional geometrical shapes and / or data representing at least one position or trajectory of the body part detected in an active detection zone. Thus "boxes" are defined in which the presence of a part of the determined body is identified, and the displacement of the succession of "boxes" corresponding to the displacement of the part of the detected body is analyzed.
    In a preferred embodiment of the invention, the passenger compartment of the vehicle is equipped with a plurality of detection modules that are distinct from one another, as much by their operation as by their location and / or orientation. More precisely, the detection modules differ from one another in that they consist of sensors of a different technological nature (microphone, motion detector, camera, etc.) capable of detecting a plurality of commands of a different nature (voice or gesture). Said detection modules may also differ from each other in that they can be fixed and / or mobile. By fixed detection module means sensors and / or embedded cameras, permanently integrated into the passenger compartment. By mobile detection module is meant sensors and / or cameras integrated in an independent multimedia device, for example a mobile phone, arranged and connected in the passenger compartment by an occupant of the vehicle. It is understood that said detection modules differ from each other by their location in the vehicle since they are integrated in specific areas separate from the passenger compartment and targeted to active detection areas. The heterogeneity of the detection modules has the consequence of diversifying the communication links between the elements of the device according to the invention. Wired technologies associated with embedded elements (wired and / or multiplexed communication, for example of the CAN / L1N type) of wireless technologies, referred to as "wireless" in English, associated with the mobile elements (for example Bluetooth communication) will be distinguished.
    The data acquired and generated by the plurality of detection modules constitute data representative of at least one voice and / or gesture sequence executed by at least one occupant of the vehicle, said representative data are transmitted to the electronic control unit ECU of the vehicle. control device according to the invention via a wireless and / or wired and / or multiplexed communication network.
    According to an advantageous characteristic of the invention, the electronic control unit ECU of the indoor lighting control device is a central data processing unit connected, upstream, to a plurality of detection and control recording modules. voice and / or gestures and, downstream, to a plurality of interior lighting modules.
    The operating principle of the electronic control unit of the control device according to the invention is based on the interdependence existing between a plurality of voice and / or gestural sequences executed by at least one occupant of the vehicle, preferably by a member. said occupant, detected in a plurality of specific active detection zones of the passenger compartment and a plurality of functions of activation of the lighting of the passenger compartment.
    According to this operating principle, the electronic control unit ECU is configured to perform at least one of the following steps: receiving a plurality of data representative of at least one voice and / or gesture sequence detected and recorded by at least one of a module for detecting and recording voice and / or gesture control, - processing and analyzing said data representative of the voice sequence and / or relating to the mono, bi or three-dimensional geometrical shape and / or the position of the sequence gesturing, - aggregating said representative data of a plurality of command sequences and from heterogeneous sources, to obtain merged and synthesized representative data, - comparing the merged representative data with reference sequences stored in a database , - determining whether said recorded vocal and / or gestural sequences are anal ogues to at least one of the reference sequences and if this similarity makes it possible to reach the conditions for triggering a lighting function, - arbitrate and prioritize the data in the event of contradictory and concurrent commands executed by a plurality of occupants in order to to favor, for security reasons, the command executed by the driver, - to select, generate and transmit, at the output (downstream), at least one activation instruction to at least one lighting module, said instruction being the most appropriate to the safety of the vehicle.
    In order to obtain the activation of at least one gestural lighting module, an occupant of the vehicle sets in motion all or part of one of its upper limbs and executes, voluntarily and specifically, a gestural sequence in a specific area of active detection of the passenger compartment. Thanks to the detection, analysis, comparison and control steps specific to the control device according to the invention, any other parasitic movement has no effect on the activation of the lighting modules.
    According to an advantageous characteristic, the electronic control unit ECU has a capacity for learning new voice and / or gestural sequences, which can be recorded in order to feed the database into new reference sequences.
    As has been previously stated, the heterogeneity of the detection and recording modules has the consequence of diversifying the communication links between the elements of the device according to the invention. The upstream communication means of the downstream communication means will then be distinguished. The upstream communication means are configured to circulate data representative of at least one generated interior lighting control and transmitted by at least one onboard and / or mobile detection and recording module to the input of the unit electronic control ECU. Said upstream communication means constitute a wireless communication network, preferably of the Bluetooth type, and / or wired and / or multiplexed, preferably of the CAN type.
    The downstream communication means are configured to circulate at least one instruction output from the electronic control unit ECU to at least one lighting module and constitute a multiplexed communication network, preferably of the CAN and / or LIN type.
    According to one characteristic of the invention, the upstream and downstream communication means may consist of a common multiplexed network. The invention also relates to a voice and / or gesture recognition control method for the interior lighting of a motor vehicle in which at least one of the following is successively carried out following a voice and / or gesture command from at least one occupant in a specific zone for detecting the passenger compartment, at: a step of detecting at least one voice sequence and / or two-dimensional and / or three-dimensional images of a gesture sequence, a step of analyzing the signal voice and / or images for generating data representative of at least one detected voice and / or gesture sequence; - a step of transmitting said representative data to at least one electronic control unit ECU via a communication network; a step of processing said representative data voice and / or gesture control, - a transmission step, if the triggering conditions are reached, via a r multiplexed communication bucket, at least one control command of a lighting module, and in particular an instruction for switching on and / or extinguishing and / or varying the luminous intensity of a light beam emitted in the passenger compartment by at least one integrated interior lighting module of the vehicle.
    It can be provided that the processing step comprises at least one of the following steps: a step of analyzing said data relating to the voice sequence and / or mono, bi or three-dimensional geometrical shape and / or to the position and / or or at the path of said gesture sequence, - a step of merging said relative data in order to obtain merged representative data, - a step of comparing said merged representative data relating to said voice and / or gesture sequence recorded at least once voice sequence and / or reference gesture stored in a database, - a step for determining whether triggering conditions of a lighting function are reached, - a step of prioritizing the representative data merged in case of contradictory commands and concomitant performed by a plurality of occupants in order to privilege, for reasons of security it is the command executed by the driver.
    According to an advantageous characteristic, the control method may include a step of learning at least one new voice and / or gestural reference sequence. This learning step can be performed according to an iterative process in which the user repeats the same voice and / or gesture sequence so that the ECU can synthesize it and generate an average voice signal and / or mean movement defining a new voice sequence and / or gesture reference.
    Moreover, and in the case of a gesture recognition control, it is possible to implement in the analysis step a gestural sequence detection means and a means for acquiring distinct images capable of interacting with one another. with the other, said image acquisition means being implemented only when the detection means has detected the initiation of a gesture that can initiate a gesture sequence.
    In an alternative to this last embodiment, it is possible to implement in the analysis step an image acquisition means which continuously recovers images targeted on the detection zone. Other features and advantages of the invention will appear more clearly on reading the detailed description of an embodiment of the invention, given by way of illustrative and nonlimiting example and based on the figures in which the voice and / or gesture recognition control device for the interior lighting of a vehicle according to the invention (FIG. 1) and the associated method (FIG. 2) have been illustrated.
    A voice and / or gesture recognition control device for the interior lighting of a vehicle 1 comprises a plurality of light sources capable of emitting each at least one light beam. In the case described below, these light sources are arranged in a plurality of lighting modules Mn configured to provide functional lighting and / or ambient lighting and / or lighting for the projection of information. The device further comprises separate detection means Cn targeted at a plurality of specific zones Zn of the house. Said detection means Cn are capable of detecting a plurality of commands formed by determined sequences Sn executed by at least one occupant of the vehicle in at least one specific area of the house, and in particular voice and / or gestural sequences.
    The functional lighting modules, for example of the reading light type, can comprise at least one light-emitting diode LED light source housed, for example, in the ceiling block and / or in each specific zone Zn of the passenger compartment.
    The ambient lighting modules may be, for example, consist of a matrix of selectively activatable light-emitting diodes, said diode matrix being housed in the ceiling unit.
    The lighting module for the projection of information may consist of a projector whose light source is located, for example, in the ceiling block.
    The device according to the invention also comprises an electronic control unit ECU configured to respond to a plurality of input data representative of the Sn sequences detected, recorded and generated by the plurality of sensors Cn, to identify the situation as a function of multiple variables detected. and selecting at least one activation instruction An of at least one interior lighting module M ", which should be the most appropriate for the safety of the vehicle. The electronic control unit ECU analyzes predetermined multiple inputs to determine the lighting function to be controlled. The ECU electronic control unit comprises, at least, a processor, data processing and analysis means, calculation means, a memory and a data storage means. The data storage means includes the database containing the voice and / or gesture reference sequences, the lighting function activation instructions executable by the processor and any receive and data transmission instructions.
    FIG. 1 illustrates, by way of example, a configuration of the device according to the invention in which three specific zones of the house are defined: a conducting zone Z "a front passenger zone Z2, a rear passenger zone Z3. Each zone is associated with at least one voice and / or gesture detection module C "C2, C3 consisting of at least one sensor, which may be, for example, a microphone and / or a motion detector and / or an IR camera and / or a mobile phone camera and at least one interior lighting module M "M2, M3, which may be, for example, a reading light and / or a ceiling light and / or a LED source RGB (Red Green Blue, in English) and / or an LED matrix.
    In the case of a voice command, the acquisition of the voice sequences can be performed by a detection module, and if necessary recording, microphone type. A plurality of voice messages makes it possible to turn on, turn off and / or modify the light intensity of a plurality of lighting modules Mn associated with a plurality of detection zones Zn. The captured speech signal is then digitized using an analog-to-digital converter.
    In the case of a gesture recognition control, the detection module, and possibly the recording module, of a gesture sequence may consist of one or more means for detecting a gestural sequence and a or several means (s) of acquiring images. These elements of the detection module interact and communicate with each other so as to detect, capture, record at least one gesture sequence executed, in a specific area of active detection of the passenger compartment, by at least one occupant of the vehicle.
    The means (s) for acquiring images can be arranged independently of the detection means in the passenger compartment, it being understood that at least one detection means and an image acquisition means are configured to target the same part of the cabin. It is understood that the advantage of decoupling these two means is to control the ignition of the image acquisition means only when the detection means have noted the beginning of a movement that may correspond to a gestural sequence. This avoids having image acquisition means operating continuously. However, as has been previously stated, it would be possible to use only one device combining the detection means and the image acquisition means.
    A gesture sequence is defined by a vertical, horizontal and / or diagonal trajectory executed in an active detection zone. The speed of execution of the gestural sequence can also be taken into account in order to distinguish a simple gesture gesture gesture sequence, a so-called directional gesture sequence.
    Depending on the quantity of lighting modules M "to be activated and their positioning in the passenger compartment, many combinations of gestures associated with specific detection zones Zn can be created so as to constitute a functional sign language intended to to light, extinguish and / or modify the luminous intensity of a lighting module Mn All of these vocal and / or gestural combinations constitute the reference sequences on the basis of which the electronic control unit ECU will analyze and compare the representative data of the vocal and / or gestural sequences performed by at least one occupant. These reference sequences are preferably learned and reproduced by the occupant for the purpose of activating and controlling a lighting module. The acquisition and storage of any new reference sequence, developed by a vehicle occupant, by the voice and / or gesture recognition control device 1, in particular by the electronic control unit ECU, is also possible. .
    The control method according to the invention has been explained above, and reference will be made to FIG. 2 to detail it in other words. The control method is based on the interdependence existing between a plurality of voice and / or gestural sequences Sn, a plurality of active detection zones Zn and a plurality of activation functions An of the cabin lighting as well as on the connection and communication of the constituent elements of the control device 1 between them.
    The method first comprises a detection step (a), in at least one detection zone Z "Z2, Z3 of the passenger compartment 2, an initiation of at least one voice and / or gesture sequence S" S2, S3 performed by at least one occupant of the vehicle, this step (a) being performed by at least one voice and / or gesture control detection module C "C2, C3. This detection step (a) can be followed by a step of capturing and recording (b) voice data and / or 2D and / or 3D images of said voice and / or gesture sequences performed by the detection module of gesture sequence C "C2, C3 and in the case of a gestural sequence preferably by at least one image acquisition means.
    A subsequent step of generating (c) data representative of said voice and / or gestural sequences by the gesture detection and capture module C "C2, C3 is then carried out. In the case of gestural control, said representative data constitute data defining mono, bi or three-dimensional geometrical shapes and / or data representing at least one position or trajectory in an active detection zone, for example a point or cloud of points.
    Communication is then carried out between the voice and / or gesture sequence detection module C "C2, C3 and the electronic control unit ECU, by a step of transmitting (d) said representative data to the electronic control unit. ECU, via an upstream wireless communication network 6 (Bluetooth) and / or wired and / or multiplexed (CAN). This communication then generates various successive steps, among which: a step of analyzing said data relating to the voice sequence and / or mono, bi or three-dimensional geometrical shape and / or to the position and / or trajectory of the said gesture sequence; - a step of merging (f) said relative data in order to obtain merged representative data, it being understood that the data merging may consist, by way of example, in taking into account gestural sequences operated simultaneously by several occupants of the vehicle, or taking into account several data from different detection means, for the detection of the same gesture of an occupant; a step of comparing (g) said merged representative data relating to said voice and / or gesture sequence recorded to at least one voice and / or gestural reference sequence stored in a database, a step for determining (b) if the triggering conditions of a lighting function are reached, - a prioritization step (i) of the representative data merged in the event of contradictory and concomitant commands executed by a plurality of occupants in order to privilege, for security reasons , the command executed by the driver, - if the triggering conditions are reached, it is possible to provide simultaneously, or with a slight time offset, a transmission (j) and execution (k) step, via a multiplexed communication network 7 downstream (CAN / L1N), of at least one instruction A "A2, A3 of ignition and / or extinguishing and / or variation of the luminous intensity e of a light beam emitted into the passenger compartment 2 by at least one interior lighting module M "M2, M3, M4 of the vehicle, such as, for example, a reading light, a ceiling light, a RGB LED, a LED matrix.
    In addition, the control method may comprise a learning step (k) of at least one new voice and / or gestural reference sequence. Thus, it is known to adapt the voice and / or gesture control device and the associated control method of the new features of the interior lighting device, by adapting the database of the electronic control unit.
    权利要求:
    Claims (12)
    [1" id="c-fr-0001]
    Voice and / or gesture control device (1) for the interior lighting of a motor vehicle comprising at least two light sources each capable of emitting at least one light beam into a passenger compartment (2) of the vehicle, characterized in that it comprises at least distinct detection means (3, Cn) of a plurality of commands (Sn), said detection means (3, Cn) being able to transmit data representative of said commands (Sn) to at least processing and analysis means (4, ECU) configured to merge and prioritize said data and generate, after comparison with reference data, at least one instruction (An) to at least one interior lighting module K ) ·
    [2" id="c-fr-0002]
    2. Device according to claim 1, characterized in that the detection means (3, Cn) are configured to detect a plurality of voice commands and / or gestures, executed by at least one occupant of the vehicle in specific areas (Zj de the passenger compartment (2) targeted by said detection means 3 · Device according to claim 2, characterized in that the gestural commands consist of a plurality of gestures forming a specific gestural sequence.
    [3" id="c-fr-0003]
    4. Device according to the preceding claim, characterized in that the gestural sequence is defined by its vertical and / or horizontal and / or diagonal and its speed of execution.
    [4" id="c-fr-0004]
    5- Device according to one of the preceding claims, characterized in that the detection means (3, Cn) comprise means for acquiring, from a network, data carrying said commands (Sn).
    [5" id="c-fr-0005]
    6. Device according to any one of claims 1 to 5, characterized in that it comprises at least: a plurality of detection modules (Cn) separate commands, configured to at least detect an indoor lighting control, analyze this command, and transmit data representative of said command, an electronic control unit (ECU) connected to said detection modules (Cn) and configured to process a plurality of data representative of a plurality of commands, and transmit at least one instruction (AJ resulting in at least one lighting module (MJ, upstream communication means (6) configured to circulate representative data transmitted by at least one detection module (Cj to the input of the electronic control unit (ECU), downstream communication means (7) configured to circulate at least one instruction (AJ at the output of the electronic control unit e (ECU) to at least one light source and constituting a multiplexed network.
    [6" id="c-fr-0006]
    7. Device according to the preceding claim, characterized in that the detection modules (Cj are configured to record a plurality of commands whose production sequence forms said indoor lighting control.
    [7" id="c-fr-0007]
    8. Device according to claim 6 or 7, characterized in that the electronic control unit (ECU) is configured to merge and synthesize the data representative of a plurality of commands into one or more instructions (AJ resulting.
    [8" id="c-fr-0008]
    9. Device according to the preceding claim, characterized in that the electronic control unit (ECU) is configured to prioritize the data from the different detection modules (Cj, and to establish one or more instructions (AJ resulting on the basis a selection of data from the different detection modules.
    [9" id="c-fr-0009]
    10. Device according to one of claims 6 to 9, characterized in that the electronic control unit (ECU) is configured to compare the data representative of a plurality of commands with reference data and determine according to this comparison if the trigger conditions of a lighting function are reached.
    [10" id="c-fr-0010]
    11. Device according to one of claims 6 to 10, characterized in that the upstream communication means (6) and downstream (7) consists of a common multiplexed network.
    [11" id="c-fr-0011]
    12. A voice and / or gesture recognition control method for the interior lighting of a motor vehicle during which one proceeds successively, following a voice and / or gesture (Sn) command of at least one occupant in a zone specific detection (Zn) of the cabin (2), to: - a step of detecting (a) at least one voice sequence and / or two-dimensional 2D and / or three-dimensional 3D images of a gestural sequence, an analysis step (c) of the voice signal and / or images for generating data representative of the voice and / or gesture control (S "), - a step of transmission (d) of said representative data to at least an electronic control unit (ECU), via a communication network (6), - a processing step (e, f, g, h, i) of said data representative of the voice and / or gesture control, - a step of transmission (j), if triggering conditions are reached, via a multiplexed communication network (7), at least one instruction (An) for controlling at least one light source of the vehicle. 13 · Control method according to the preceding claim, characterized in that said processing step comprises at least one of the following steps: - a step of merging (f) said relative data in order to obtain merged representative data, - a step of comparing (g) said merged representative data relating to said detected voice and / or gesture sequence to at least one reference voice and / or gesture sequence stored in a database, - a step of determining (h) whether conditions for triggering a lighting function are reached; - a step of prioritizing (i) representative data merged in the event of contradictory and concurrent commands executed by a plurality of occupants in order to privilege, for security reasons, the command executed by the driver.
    [12" id="c-fr-0012]
    14. Control method according to one of claims 12 to 13, characterized in that, in the case of a command gesture recognition, is implemented in the analysis step (c) a means of gesture sequence detection and a means of acquiring distinct images capable of interacting with each other, said image acquisition means being implemented only when the detection means has detected the initiation of a gesture that can initiate a sequence of gestures. 15 · Control method according to the preceding claim, characterized in that, in the case of a command gesture recognition, it implements in the analysis step (c) an image acquisition means which continuously recovers targeted images on the detection zone (Zj.
    类似技术:
    公开号 | 公开日 | 专利标题
    EP3222467A1|2017-09-27|Device and method for control with voice and/or gesture recognition for the interior lighting of a vehicle
    FR3048933B1|2019-08-02|DEVICE FOR CONTROLLING INTERIOR LIGHTING OF A MOTOR VEHICLE
    EP3211616A2|2017-08-30|Driver assistance apparatus
    US10834221B2|2020-11-10|Method and system for providing predictions via artificial intelligence | models using a distributed system
    FR2972592A1|2012-09-14|LED LAMP WITH VARIABLE GEOMETRY BEAM DEVICE
    FR3076680A1|2019-07-12|Inter-vehicle communication system, vehicle system, vehicle lighting system and vehicle
    EP3300953A1|2018-04-04|Interior lighting system for an autonomous motor vehicle
    FR3056495A1|2018-03-30|INTERIOR LIGHTING DEVICE FOR MOTOR VEHICLE
    CN107284353A|2017-10-24|Indoor camera apparatus including its vehicle parking assistance device and vehicle
    FR3015700A1|2015-06-26|SYSTEM AND METHOD FOR CONTROLLING THE BRIGHTNESS OF A HIGH HEAD DISPLAY AND DISPLAY USING THE SAME
    FR3053648A1|2018-01-12|AUTONOMOUS DRIVING METHOD FOR VEHICLE
    WO2018158163A1|2018-09-07|Device for determining the attentiveness of a driver of a vehicle, on-board system comprising such a device, and associated method
    KR102163317B1|2020-10-08|Control method for vehicle
    FR3076777A1|2019-07-19|Vehicle and vehicle lighting system
    FR3061793A1|2018-07-13|METHOD AND DEVICE FOR MONITORING A STATIONED MOTOR VEHICLE
    FR3050700A1|2017-11-03|DEVICE FOR AIDING THE MOVEMENT OF A USER CLOSE TO A MOTOR VEHICLE
    FR3056494A1|2018-03-30|INTERIOR LIGHTING DEVICE FOR A MOTOR VEHICLE HABITACLE AND METHOD FOR CONTROLLING SUCH A DEVICE
    WO2018189232A1|2018-10-18|Luminous lane-change signalling device for a motor vehicle
    EP2489548B1|2017-09-06|Method for controlling the switching of an adaptive headlight system of an automobile
    FR3047942A1|2017-08-25|INTERIOR LIGHTING DEVICE OF A MOTOR VEHICLE INTERIOR
    FR3075136B1|2019-11-08|METHOD AND DEVICE FOR ASSISTING DRIVING A PARTIALLY AUTOMATED DRIVING VEHICLE BY COMPARING GLOBAL STATES
    EP3730334A1|2020-10-28|Device for controlling for a motor vehicle, associated motor vehicle, control method and computer program
    KR102192144B1|2020-12-17|Vehicle control device and vehicle control method
    JP2022018497A|2022-01-27|Information recording device, information recording method and information recording system
    FR3052578B1|2019-07-12|OPTICAL FACE SURVEILLANCE SYSTEM OF A CONDUCTOR AND METHOD OF IMPLEMENTING THE SAME
    同族专利:
    公开号 | 公开日
    CN107219838A|2017-09-29|
    JP2017171287A|2017-09-28|
    EP3222467A1|2017-09-27|
    US20170270924A1|2017-09-21|
    JP6825947B2|2021-02-03|
    US10937419B2|2021-03-02|
    FR3049078B1|2019-11-29|
    引用文献:
    公开号 | 申请日 | 公开日 | 申请人 | 专利标题
    US20130088147A1|2011-10-11|2013-04-11|Hyundai Motor Company|Organic electro-luminescence lighting device for vehicle|
    WO2013174580A1|2012-05-23|2013-11-28|Volkswagen Aktiengesellschaft|Device for controlling lighting in a vehicle interior|
    EP2746805A1|2012-12-21|2014-06-25|Delphi Technologies, Inc.|Ultrasonic surveillance system for the interior of a motor vehicle|
    US20140197757A1|2013-01-15|2014-07-17|Hella Kgaa Hueck & Co.|Lighting device and method for operating the lighting device|
    EP2977264A2|2014-07-25|2016-01-27|Audi Ag|Actuating assembly for a motor vehicle and motor vehicle|
    JP3619380B2|1998-12-25|2005-02-09|富士通株式会社|In-vehicle input / output device|
    US8768286B2|2001-10-24|2014-07-01|Mouhamad Ahmad Naboulsi|Hands on steering wheel vehicle safety control system|
    US8745541B2|2003-03-25|2014-06-03|Microsoft Corporation|Architecture for controlling a computer using hand gestures|
    US7665041B2|2003-03-25|2010-02-16|Microsoft Corporation|Architecture for controlling a computer using hand gestures|
    US8094127B2|2003-07-31|2012-01-10|Volkswagen Ag|Display device|
    US7295904B2|2004-08-31|2007-11-13|International Business Machines Corporation|Touch gesture based interface for motor vehicle|
    JP4930315B2|2007-01-19|2012-05-16|株式会社デンソー|In-vehicle information display device and light irradiation device used therefor|
    JP5376203B2|2008-09-16|2013-12-25|アイシン精機株式会社|Electric seat system for vehicles|
    US9348417B2|2010-11-01|2016-05-24|Microsoft Technology Licensing, Llc|Multimodal input system|
    US20120278729A1|2011-04-27|2012-11-01|Vennelakanti Ramadevi|Method of assigning user interaction controls|
    US9866277B2|2011-08-15|2018-01-09|Adam James Wang|Vehicle wireless hub|
    US8311973B1|2011-09-24|2012-11-13|Zadeh Lotfi A|Methods and systems for applications for Z-numbers|
    US20130152003A1|2011-11-16|2013-06-13|Flextronics Ap, Llc|Configurable dash display|
    US8767035B2|2011-12-06|2014-07-01|At&T Intellectual Property I, L.P.|In-call command control|
    WO2013149357A1|2012-04-01|2013-10-10|Intel Corporation|Analyzing human gestural commands|
    DE102012013503B4|2012-07-06|2014-10-09|Audi Ag|Method and control system for operating a motor vehicle|
    US9798799B2|2012-11-15|2017-10-24|Sri International|Vehicle personal assistant that interprets spoken natural language input based upon vehicle context|
    CN203305887U|2013-01-17|2013-11-27|欧司朗有限公司|Vehicle-mounted illuminating device and vehicle with same|
    US9349365B2|2013-03-14|2016-05-24|Accenture Global Services Limited|Voice based automation testing for hands free module|
    KR20140113832A|2013-03-15|2014-09-25|현대자동차주식회사|Voice transmission starting system and starting method for vehicle|
    US9170724B2|2013-04-01|2015-10-27|Jet Optoelectronics Co., Ltd.|Control and display system|
    US20140309871A1|2013-04-15|2014-10-16|Flextronics Ap, Llc|User gesture control of vehicle features|
    US9931991B2|2013-11-21|2018-04-03|Ford Global Technologies, Llc|Rotating garment hook|
    US9839098B2|2013-11-21|2017-12-05|Ford Global Technologies, Llc|Light assembly operable as a dome lamp|
    KR101556521B1|2014-10-06|2015-10-13|현대자동차주식회사|Human Machine Interface apparatus, vehicle having the same and method for controlling the same|
    US10928914B2|2015-01-29|2021-02-23|Misapplied Sciences, Inc.|Individually interactive multi-view display system for non-stationary viewing locations and methods therefor|
    US20170032783A1|2015-04-01|2017-02-02|Elwha Llc|Hierarchical Networked Command Recognition|
    US9802535B2|2015-04-27|2017-10-31|Ford Global Technologies, Llc|Seat having ambient lighting|
    CN104966514A|2015-04-30|2015-10-07|北京车音网科技有限公司|Speech recognition method and vehicle-mounted device|JP6447578B2|2016-05-27|2019-01-09|トヨタ自動車株式会社|Voice dialogue apparatus and voice dialogue method|
    US10950229B2|2016-08-26|2021-03-16|Harman International Industries, Incorporated|Configurable speech interface for vehicle infotainment systems|
    US10934764B2|2016-09-08|2021-03-02|Magna Closures Inc.|Radar detection system for non-contact human activation of powered closure member|
    US11067667B2|2016-09-08|2021-07-20|Magna Closures Inc.|Radar detection system for non-contact human activation of powered closure member|
    DE102017004579A1|2017-05-12|2018-11-15|Diehl Aerospace Gmbh|Light and luminaire module|
    JP2020001529A|2018-06-27|2020-01-09|矢崎総業株式会社|In-vehicle lighting system|
    CN111231870A|2018-11-28|2020-06-05|上海博泰悦臻电子设备制造有限公司|Vehicle sleep mode switching method and device|
    CN109976515A|2019-03-11|2019-07-05|百度在线网络技术（北京）有限公司|A kind of information processing method, device, vehicle and computer readable storage medium|
    JP2020175791A|2019-04-19|2020-10-29|矢崎総業株式会社|Lighting control system and lighting control method|
    CN111263498A|2020-01-21|2020-06-09|中山市德马汽车零部件有限公司|Automobile atmosphere lamp control system, method and device and storage medium|
    JP2021123300A|2020-02-07|2021-08-30|トヨタ自動車株式会社|Indoor lighting system|
    法律状态:
    2017-03-31| PLFP| Fee payment|Year of fee payment: 2 |
    2017-09-22| PLSC| Publication of the preliminary search report|Effective date: 20170922 |
    2018-03-29| PLFP| Fee payment|Year of fee payment: 3 |
    2019-03-29| PLFP| Fee payment|Year of fee payment: 4 |
    2020-03-31| PLFP| Fee payment|Year of fee payment: 5 |
    2021-03-30| PLFP| Fee payment|Year of fee payment: 6 |
    优先权:
    申请号 | 申请日 | 专利标题
    FR1652417A|FR3049078B1|2016-03-21|2016-03-21|VOICE AND / OR GESTUAL RECOGNITION CONTROL DEVICE AND METHOD FOR INTERIOR LIGHTING OF A VEHICLE|
    FR1652417|2016-03-21|FR1652417A| FR3049078B1|2016-03-21|2016-03-21|VOICE AND / OR GESTUAL RECOGNITION CONTROL DEVICE AND METHOD FOR INTERIOR LIGHTING OF A VEHICLE|
    EP17161175.9A| EP3222467A1|2016-03-21|2017-03-15|Device and method for control with voice and/or gesture recognition for the interior lighting of a vehicle|
    JP2017052783A| JP6825947B2|2016-03-21|2017-03-17|Control devices and methods with voice and / or gesture recognition for interior lighting|
    CN201710169273.2A| CN107219838A|2016-03-21|2017-03-21|With the sound illuminated for vehicle interior and/or the control device of gesture recognition and method|
    US15/465,087| US10937419B2|2016-03-21|2017-03-21|Control device and method with voice and/or gestural recognition for the interior lighting of a vehicle|
    [返回顶部]